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Assistant Commissioner for Patents 
Washington, D. C. 20231 

Dear Sir: 
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IN THE ABSTRACT 
Insert the attached Abstract page into the application as the last page thereof. 
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A courtesy copy of the present specification is enclosed herewith. However, the 
World Intellectual Property Office (WIPO) copy should be relied upon if it is already in the U.S. 
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IN THE CLAIMS 
Please amend the following claims: 



3. (Amended) Encoding method according to claim 1, characterized in that it enables 
access to several levels of encoding quality, corresponding to each of said successive meshes. 



4. (Amended) Encoding method according to claim 1, characterized in that said 
successive meshes are obtained by the implementation of a recursive algorithm. 

5. (Amended) Encoding method according to claim 1, characterized in that said recursive 
algorithm comprises the following steps: 

(a) the reception (3 1) of a wavelet coefficient indexed by a vertex (s) of barycentric 
coordinates (a,f3,y) on a face F 0 ; 

(b) for each neighboring face Fj of F 0 containing said vertices (s): 

F = F; is supposed; 

from the barycentric coordinates (a,p\y), the coordinates of said 
vertex (s) in the refined base (42) formed by the vertices of the face 
F, also referenced (a,p,y) are deduced; 

if the coordinates a, (3 or y are positive or zero and if two of them 
are strictly positive (43): 

the face F (45) is subdived; 

the processing of the step (b) is resumed for the four 
offspring of the face F successively 
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8. (Amended) Application of the encoding method according to claim 1 to at least one of 
the following fields: 

the display of meshed objects in a 3D screen; 

the progressive display of meshed objects in three dimensions on a screen, said 

wavelet coefficients being taken into account as and when they arrive; 

the display of meshed objects in three dimensions on a screen with at least two 

levels of detail, one level of detail corresponding to one of said successive meshes 

(MJ; 

the display of different parts of a meshed object with at least two different levels 
of detail; 

the compression of a mesh of a meshed obj ect. 



REMARKS 

The above preliminary amendment is made to remove multiple dependencies from 
claims 3,4,5 and 8. 

A new abstract page is supplied to conform to that appearing on the publication 
page of the WIPO application, but the new Abstract is typed on a separate page as required by 
U.S. practice. 

Applicants respectfully request that the preliminary amendment described herein 
be entered into the record prior to calculation of the filing fee and prior to examination and 
consideration of the above-identified application. 
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ABSTRACT 



Title: SELECTIVE MESH REFINEMENT 

The invention concerns a method for coding an original mesh representing a three- 
dimensional object, which consist in determining a simple meshing having a reduced number of 
defined faces each defined by vertices and edges, then coefficients in a wavelet base of a 
function whereof said source mesh is the image defined on said simple mesh, so as to supply 
successive refined meshes. The method is characterized in that each of the faces of said meshes 
is subdivided into a limited number of facets to form the higher level mesh, the subdivisions of 
said surface corresponding only to those required for observing an affinity condition of said 
function of said face. The invention also concerns the corresponding method for reconstructing 
the mesh. 



Marked-up Copy 



3. Encoding method according tojone of the claims 1 andjj, characterized in that it enables 
access to several levels of encoding quality, corresponding to each of said successive meshes. 



4. Encoding method according to^uny of the claims 1 toJ| characterized in that said successive 
meshes are obtained by the implementation of a recursive algorithm. 

5. Encoding method according to any of the claims 1 to 4j characterized in that said recursive 




algorithm comprises the following steps: 

(a) the reception (3 1) of a wavelet coefficient indexed by a vertex (s) of barycentric 
coordinates (a,(3,y) on a face F<>; 

(b) for each neighboring face Fj of Fq containing said vertices (s): 



F = Fi is supposed; 

from the barycentric coordinates (oc,p\y), the coordinates of said 
vertex (s) in the refined base (42) formed by the vertices of the face 
F, also referenced (a,p\y) are deduced; 

if the coordinates a, f3 or y are positive or zero and if two of them 
are strictly positive (43): 

the face F (45) is subdived; 

the processing of the step (b) is resumed for the four 

offspring of the face F successively 







8. Application of the encoding method according tojany of the claims 1 tol|to at least one of the 
following fields: 

the display of meshed objects in a 3D screen; 

the progressive display of meshed objects in three dimensions on a screen, said 

wavelet coefficients being taken into account as and when they arrive; 

the display of meshed objects in three dimensions on a screen with at least two 

levels of detail, one level of detail corresponding to one of said successive meshes 

(MO; 

the display of different parts of a meshed object with at least two different levels 
of detail; 

the compression of a mesh of a meshed obj ect. 
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SELECTIVE MESH REFINEMENT 



The field of the invention is that of the encoding of images or image 



elements. More specifically, the invention relates to the adaptive representation 
and encoding of scenes (or objects of a scene) in three dimensions (3D) 
represented by meshes. 

The invention can be applied in all fields where it is desirable to reduce the 
number of information elements needed for the efficient depiction, storage and/or 
transmission of a digital image. For example, the invention may be used to 
transmit images through the Internet. In this context, it enables the animation of 
3D scenes with real-time display although the bit rate is neither constant nor 
ensured. In this case, the invention may be a primitive of a data transmission 
language such as VRML. 

Other applications that may be envisaged include the storage of animated 
data on CD-ROM (or an equivalent data carrier), multiple-user applications, 
digital television, etc. 

The invention proposes an improvement to so-called "wavelet" methods 
used to represent a mesh as a sequence of details added to a basic mesh. The 
general theory of this technique is described especially in the article by 
M. Lounsberry, T. DeRose and J. Warren, "Multiresolution analysis for surfaces 
or arbitrary topological type" (ACM Transaction on Graphics, Vol. 16, No. 1, pp. 



According to this technique, a mesh is therefore represented by a sequence 
of coefficients that correspond to the coordinates in a base of wavelets of a 
parametrization of said mesh by a simple polyhedron. The corresponding 
mathematical principles are recalled in the appendix (this appendix forms part of 
the present description). 

In practice, during the reconstruction, the basic mesh M 0 is shown in tree 
form: each of its faces is the root of a tree for which the offspring of each node 
are the four faces obtained after canonical subdivision. The wavelet coefficients 
are indexed by their barycentric coordinates on one face of M 0 . 



34-73). 



A subdivision technique has been proposed by A. Certain, Jovan Popovic, 
T. DeRose, T. Duchamp, D. Salesin and W. Stuetzle in the article "Interactive 
Multiresolution Surface Viewing" (Computer Graphics Proceedings 1996). 

This technique consists in making subdivisions by observing a sufficient 
condition on the vertices: a vertex is said to be full if it is in the middle of a ridge 
shared by two faces that are subdivided into four as shown in Figure 1. 

The principle lies in starting from the vertex indexing the wavelet 
coefficient considered and, by subdivision, making its neighbors and then the 
neighbors of its neighbors complete, recursively until all the vertices are 
considered to be complete. This rule is derived from the observation that this 
algorithm is sufficient to provide for a subdivision adapted to the modifications 
made by the wavelet coefficient considered. 

However, this technique has a major drawback: it induces the creation of 
unnecessary facets, leading to an unnecessary increase in the number of data 
elements necessary for the description of the mesh. More specifically, 
unnecessary facets are created by subdivisions that give the completeness of the 
vertices referred to further above. 

In other words, there is a creation, in zones relatively distant from the 
support of the observed wavelet, of coplanar facets. This unnecessarily lowers the 
efficiency of the display of the object. 

It is indeed known that the number of data elements (and therefore the 
number of facets) has major consequences especially when the object concerned is 
animated, the power of the terminal is limited and/or the transmission bit rate is 
variable and/or limited. 

It is an aim of the invention especially to overcome these drawbacks of the 
prior art. 

More specifically, it is an aim of the invention to provide a method for the 
encoding of a mesh representing a 3D object that produces a number of facets that 
is limited, as compared with the prior art, for an identical or similar quality of 
restitution. 
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Another aim of the invention is to provide an encoding method of this kind 
whose complexity (especially in terms of numbers of operations performed and 
memory capacity needed) is smaller, or at least of the same magnitude, as that of 
the known techniques. 

5 It is also an aim of the invention to provide an encoding method of this 

kind, that can be used to have several levels of quality of restitution of the object, 
as a function of various criteria (processing capacity of the terminal, capacity of 
the available storage means, transmission bit rate, the user's needs, etc.). 

Yet another aim of the invention is to provide an encoding method of this 

10 kind that can be used for a progressive reconstruction of the object. 

It is also an aim of the invention, naturally, to provide a method of 
reconstruction of an object encoded according to this encoding method. 

These aims and others that shall appear hereinafter arc achieved according 
to the invention by means of a method for the encoding of a source mesh (M) 

15 representing a 3D object in which there is determined a simple mesh (M 0 ) with a 
limited number of faces, each defined by vertices and ridges, and then coefficients 
in a base of wavelets of a function (f), of which said source mesh is the image 
defined on said simple mesh (Mo), so as to give a subdivision of said source mesh 
(M) into successive refined meshes (or sub-meshes) (Mj), according to a 

20 predetermined criterion. According to the invention, each of the faces of said 
meshes (Mj) is subdivided into a limited number of facets to form the higher-level 
mesh (Mj +1 ), the subdivisions of said face corresponding solely to those needed to 
comply with a condition of affinity of said function (f) on said face. 

Indeed, the inventor has observed that the taking into account of a wavelet 

25 coefficient must be accompanied by a local subdivision in the vicinity of the 
vertex indexing the wavelet in question, so that this wavelet can be refined by 
pieces on said facet. Since, the wavelets are the sums of functions it is 
sufficient to be able to localize the support of such a function and locally 
subdivide the facets that contain them until this function is refined on each 

30 resultant facet. 
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It will be noted hereinafter that the terms "face" and "facet" are used 
without distinction. In general, a "facet" is a subdivision of a "face". 

Advantageously, said source mesh (M) is subdivided up into a set of trees, 
each of said trees representing a face of said simple mesh (M 0 ) and comprising 
5 nodes each representing a face of a mesh (Mj), said function (f) being refined on 
each of said faces. Then, each of said trees is the smallest such that, when a given 
face is subdivided into four facets, the corresponding node comprises four 
offspring representing said four facets. 

Advantageously, the method of the invention enables access to several 
10 levels of encoding quality, corresponding to each of said successive meshes. 

This is easy because of the very structure of the subdivision as shall be 
seen hereinafter. 

Preferably, said successive meshes are obtained by the implementation of 
a recursive algorithm. The method is thus particularly simple to implement. 
15 According to an advantageous embodiment, said recursive algorithm 

comprises the following steps: 

(a) the reception of a wavelet coefficient indexed by a vertex (s) of 
bary centric coordinates (a, (3, 7) on a face Fq; 

(b) for each neighboring face Fj of F 0 containing said vertices (s): 
20 - F = F{ is supposed; 

from the barycentric coordinates (a, (3, y), the coordinates 
of said vertex (s) in the refined base formed by the vertices 
of the face F, also referenced (a, (3, y), are deduced ; 
if the coordinates a, (3 or y are positive or zero and if two of 
25 them are strictly positive: 

the face F is subdivided; 

the processing of the step (b) is resumed for the four 
offspring of the face F successively. 



The invention also relates to a method of reconstruction of a source mesh 
(M) representing a 3D object encoded according to the encoding method 
described here above. 

Advantageously, a method of reconstruction of this kind provides for the 
progressive reconstruction of said object using the simple mesh (Mo) and then by 
means of successive meshes (M-). 

Preferably, this method of reconstruction enables access to several levels 
of quality of encoding, corresponding to each of said successive meshes. 

The invention can be applied advantageously to several fields and can be 
applied especially to at least one of the following fields: 

the display of meshed objects in a 3D screen; 
the progressive display of meshed objects in three dimensions on a 
screen, said wavelet coefficients being taken into account as and 
when they arrive; 

the display of meshed objects in three dimensions on a screen with 
at least two levels of detail, one level of detail corresponding to one 
of said successive meshes (M{); 

the display of different parts of a meshed object with at least two 

different levels of detail; 

the compression of a mesh of a meshed object. 
Other features and advantages of the invention shall appear more clearly 
from the following description of a preferred embodiment of the invention given 
by way of a simple non-restrictive illustration and from the appended drawings, of 
which: 

- Figure 1, already commented upon in the introduction, illustrates a 
complete vertex according to the technique used by Certain et al.; 

- Figure 2 illustrates the direct neighborhood of a vertex s according to the 
invention; 

- Figure 3 is a simplified general block diagram of the encoding method 
according to the invention; 



- Figure 4 is a more detailed block diagram, resuming and detailing the 
steps of localization and subdivision of Figure 3. 

The method of encoding a mesh according to the invention is therefore 
aimed especially at carrying out the minimum number of subdivisions needed 
while at the same time retaining the same algorithmic complexity as in the prior 
art. 

Throughout the rest of this document, it will be said that a point s has 
barycentric coordinates (a, (3, y), on a face F 0 if its barycentric coordinates in the 
refined base formed by the vertices of F 0 are (a, |3, y). Also, M 0 will not be 
specified when there is no possible confusion. 

The basic algorithm of the invention, independently of any 
implementation, is the following: 

1. Receive a wavelet coefficient indexed by a vertex s having 
barycentric coordinates (a, |3, y), on a face F 0 . 

2. For each neighboring face F { of F 0 containing s: 

(a) F = F r 

(b) Deduce (a, p, y) the coordinates of s in the refined base 
formed by the vertices of F also referenced (a, 0, y). 

(c) If a or (3 or y are all positive or null or if two of them are 
strictly positive: 

i. subdivide F 

ii. start again at (b) with, for F, its four offspring 
successively. 

When the algorithm stops, there is a minimum subdivision of M 0 obtained 
with a complexity in linear time as compared with the degree of subdivision. The 
transmission bit rate and/or the storage capacity needed are therefore optimized. 

It must be noted that the invention is used to determine not only the 
minimum tree corresponding to f, but also each of its approximations, in 
truncating the sum (see appendix): 
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Since the sum is precisely obtained progressively, by adding terms one 
after the other, the operation passes from a tree representing an approximation f { 
to a tree representing: 

(where c J ' f is a wavelet coefficient transmitted in performing only the facet 
subdivisions strictly necessary for the condition of affinity on each face. 

It is thus possible to progressively reconstruct the object and/or to choose a 
level of quality (corresponding to the index j). 

The progressively reconstructed mesh can be represented as n 4-trees 
describing the successive divisions of the n faces of the mesh M 0 transmitted prior 
to the wavelet coefficients. Each wavelet coefficient received is accompanied by 
three integers A, B and C proportional to the bary centric coordinates of the vertex 
s indexing the wavelet associated with the coefficient, as well as an integer 
designating the face F 0 indicating a facet containing s. 

If s belongs to Mj+1, A, B and C are deduced from the barycentric 
coordinates cc,p and y of s in the refined base formed by the vertices of F 0 by: 

(A, B, C) = 2J +1 (cc,p, y) 
The wavelet centered at s has the form: 

fceD 

where D is the neighborhood of s on the mesh Mj. The technique explained in the 
previous part must therefore be applied to each of the functions that appear in the 
sum, with their respective barycentric coordinates. 

These barycentric coordinates are expressed in the same refined base as 
those of s and deduced from these coordinates: the neighborhood D is, for a value 



of k that is fixed, the set of vertices of Mj at a distance of at most k ridges from 
one of the ends s l and s 2 of the ridge of Mj containing s, as shown in Figure 2. 
The barycentric coordinates of these two vertices are characterized by the 
following criterion: 

The triplet (a', |3', y r ) represents the coordinates of one of these two 
points if and only if the triplet of integers (A 1 , B', C) = 2J (a', |3', y') 
verifies: 

(2A' - A, 2B' - B, 2C - C) e e 
where s designates the set: 

{(1, -1, 0), (-1, 1, 0), (1, 0, 1), (-1, 0, 1), (0, 1,-1), (0, -1, 1)} 

With these two direct neighbors of s, s l and s 2 being determined, the others are 
determined by applying the following criterion k times: 

let u and v be two vertices with barycentric coordinates (a', |3', y) and (a", |3", y") 
respectively on a face F. Then u and v are connected by a ridge on Mj if and only 
if: 

2i(a' - a", |3' - (3", y'-y M )Ee 

giving explicitly the list of the vertices in the neighborhood D. 

Each of these vertices, provided with its barycentric coordinates (a, €p\ y) 
may thus give rise to the subdivisions needed for the modifications made by the 
corresponding function & according to a variant of the algorithm described further 
above. The operation starts from the pair (A, B, C) = 2 j (a, p, y) where j is the 
smallest integer such that A, B and C are integers and, at each subdivision, the 
basic change matrix of this triplet is applied in such a way that tests of positivity 
are made only on the integers. 

The four matrices of passage of the refined base represented by the three 
vertices of a face with refined bases represented by the three vertices of each of 
the offspring are explicitly: 
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The method described here above is illustrated in a very simplified way in 
Figure 3. For each wavelet coefficient received (31), a localization step 32 is 
performed in which the elements to be processed are brought into the appropriate 
refined base and then a step of subdivision (33) of each face considered is 
performed. 

A more detailed exemplary implementation of these two steps 32 and 33 is 
shown in Figure 4. 

In the localization 32, with ip J , being written as a weighted sum of scale 
functions at the level j+1, the faces and the barycentric coordinates of the points of 
M 0 (or vertices of Mj) indexing these scale functions are determined. 

Then, for each triplet with coordinates (a, |3, y) associated with a face F 
(41), the coordinates (a', |3', y) corresponding to (a, 0, y) in the base of the 
vertices of F are computed (42) and (a, |3, y) = (a', |3', y') is supposed. 

Then the test 43 is performed: 
(a > 0) and ((3 > 0) and (y > 0) and ((a (3 > 0) or (a y > 0) or ((3 y > 0)) 

If the result is positive (44), a recursivity loop is made in which the face F 
is subdivided (45) into four offspring F { and then for each offspring F; (46) F = Fj 
(47) is supposed and the operation is resumed at the step 41 recursively. 

If the result of the test 43 is negative, the processing is resumed (48) for a 
new face F (41). When all the faces F have been processed, the subdivision is 
ended (49). 
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APPENDIX 

A surface S in the space may be represented as the image of a continuous 
injective function defined on a polyhedron M 0 of the topological type with values 
in R 3 . It is said then that the surface is parametrized by the polyhedron, and it is 
called the parametrization of said function. This function is a triplet of functions 
whose values in R, each of which may each be developed in a base of the space 
C°(M 0 ) of the continuous functions on the polyhedrons with values in R. 

In the case of the meshed surfaces, this technique is used to obtain a 
compressed mesh representation. Furthermore, the use of wavelets as a basic 
function provides for a progressive representation thereof from the roughest form 
to the most detailed form. 

These function are not wavelets in the standard sense but are in accordance 
with refining relationships that generalize the concept of multiple resolution 
analysis. Let M 0 denote a polyhedron on which a parametrization of a surface M 
is defined. We consider the subspace S 0 of C°(M 0 ) generated by the functions 
(f> t defined as follows: 0 ; is refined on each facet, equals 1 on the i-th vertex and 
equals 0 on all the other vertices. 

The subspaces Sj engendered by the functions (j^ are defined in the same 
way but in replacing M 0 by the mesh Mj obtained by canonically subdividing each 
facet of Mj.j. The spaces Sj are finite in dimension and nested, S 0 being the 
smallest and every continuous function of M 0 in R can be approached uniformly 
by a function of an Sj for j as a fairly large number. 

It is this inclusion that enables the progressive encoding: if Wj is taken to 
denote an additional value of Sj and Sj +1 and {ty, } f (the wavelets) a base of Wj, 
the set 

i>0 

forms a base of C°(Mo). The function p parametrizing M is written therefore in a 
unique way: 
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where the values Cj and the values d\ are in R 3 , and are called wavelet 
coefficients. 

In practice, the wavelets are chosen in such a way that their support 
enables a determining of the coefficients of wavelets at O(n) where n is the 
number of vertices of the mesh M: for k as a fixed integer, if j is taken to 
denote the set of indices of the vertices of a mesh Mj which are at a distance of 
less than k ridges from the vertex i, the wavelet 1p i is given by: 

in such a way that lp i is with a support in [. 

Thus, during the reconstruction, the influence of a wavelet coefficient is 
limited to a neighborhood of this kind. 
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CLAIMS : 

1. Method for the encoding of a source mesh (M) representing a 3D object 
in which there is determined a simple mesh (M 0 ) with a limited number of faces, 

5 each defined by vertices and ridges, and then coefficients in a base of wavelets of 
a function (f) of which said source mesh is the image defined on said simple mesh 
(M 0 ), so as to give a subdivision of said source mesh (M) into successive refined 
meshes (or sub-meshes) (Mj), according to a predetermined criterion, 
characterized in that each of the faces of said meshes (Mj) is subdivided into a 
10 limited number of facets to form the higher-level mesh (Mj +1 ), the subdivisions of 
said face corresponding solely to those needed to comply with a condition of 
affinity of said function (f) on said face. 

2. Encoding method according to claim 1, characterized in that said source 
mesh (M) is subdivided up into a set of trees, each of said trees representing a face 

15 of said simple mesh (Mq) and comprising nodes each representing a face of a 
mesh (Mj), said function (f) being refined on each of said faces 
and each of said trees being the smallest such that, when a given face is 
subdivided into four facets, the corresponding node comprises four offspring 
representing said four facets. 

20 3. Encoding method according to one of the claims 1 and 2, characterized 

in that it enables access to several levels of encoding quality, corresponding to 
each of said successive meshes. 

4. Encoding method according to any of the claims 1 to 3, characterized in 
that said successive meshes are obtained by the implementation of a recursive 

25 algorithm. 

5. Encoding method according to any of the claims 1 to 4, characterized in 
that said recursive algorithm comprises the following steps: 

(a) the reception (31) of a wavelet coefficient indexed by a vertex (s) 
of bary centric coordinates (ct,P,y) on a face F 0 ; 
30 (b) for each neighboring face Fj of F 0 containing said vertices (s): 
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F = Fj is supposed; 

from the barycentric coordinates (a,P 7 y), the coordinates of 
said vertex (s) in the refined base (42) formed by the 
vertices of the face F, also referenced (a,|3,y) are deduced; 
if the coordinates a, p or y are positive or zero and if two of 
them are strictly positive (43): 

the face F (45) is subdivided; 

the processing of the step (b) is resumed for the four 

offspring of the face F successively. 

6. Method of reconstruction of a source mesh (M) representing a 3D 
object encoded according to the encoding method of claim 1, characterized in that 
said object is reconstructed progressively, using the simple mesh (M 0 ), and then 
by means of successive meshes (Mj). 

7. Method of reconstruction according to claim 6, characterized in that it 
enables access to several levels of quality of encoding, corresponding to each of 
said successive meshes. 

8. Application of the encoding method according to any of the claims 1 to 
5 to at least one of the following fields: 

the display of meshed objects in a 3D screen; 
the progressive display of meshed objects in three dimensions on a 
screen, said wavelet coefficients being taken into account as and 
when they arrive; 

the display of meshed objects in three dimensions on a screen with 
at least two levels of detail, one level of detail corresponding to one 
of said successive meshes (Mj); 

the display of different parts of a meshed object with at least two 

different levels of detail; 

the compression of a mesh of a meshed object. 
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